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Scholars in higher education deem reflective thinking as integral to the 
development of professional disciplinary practices. One of the major issues in 
studying reflective thinking pivots around its conceptualization and assessment. 
Over the years, researchers have used several methods and scales to measure 
reflective thinking. One of the most widely known scales of reflective thinking was 
constructed and validated by Kember et al. (2000). It is entitled 'Reflective 
Thinking Questionnaire (RTQ)’ and includes 16 items measuring four types of 
reflective thinking: understanding (UND); reflection (REF); critical reflection 
(CREF); habitual action (HA). The present study aimed at validating the Persian 
version of RTQ among one hundred ninety six English as a foreign language (EFL) 
university students. It then scrutinized the role of reflective thinking in academic 
achievements measured by grade point average (GPA). The association of learners' 
reflective thinking style with their educational level and gender was also estimated. 
To conduct the research, the scale was first translated into Persian and its validity 
(computed via confirmatory factor analysis, convergent, and divergent validity 
estimates) and reliability (computed via Cronbach’s alpha) were substantiated. It 
was indicated that among the comprising factors of reflective thinking, UND 
received the highest mean followed by REF and CREF. 

Keywords: EFL learners, reflective thinking, language achievement, understanding, 
reflection, critical reflection, habitual action 

INTRODUCTION 

Higher education institutions serve three functions, namely education, research, and 
contribution to society. As proposed by Smith and Szymanski (2013), what underpins all 
these functions is to equip students for success in life by becoming fully-functioning 
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members of the society. The characteristics of higher education formulated based on 
interaction, exploration, and problem solving tasks provide the opportunities for learners 
to enhance their higher order abilities. Due to the wide-ranging functions of higher 
education, students tend to look beyond the surface of the new subject material and 
move towards mental reflections, a process known as reflective thinking which is 
acknowledged to be as one of the key skills towards sustainable development in higher 
education institutions (Dawe, Jucker, & Martin, 2005). In effect, researchers in the 
domain of higher education conceived reflective thinking as integral to the development 
of professional disciplinary practices (Barton & Ryan, 2014). It is also contended that in 
recent years, the notion of reflective thinking is increasingly incorporated to higher 
educational discourses (Moore, 2011). The term “reflection”, or “reflective thinking” is 
defined as “active, persistent, and careful consideration of any belief or supposed form 
of knowledge in the light of the grounds that support it and the conclusion to which it 
tends” (Dewey, 1933, p. 118). In other words, reflective thinking is an active and 
continuous process of thinking about any subject matter which encourages and guides 
the learning process and involves a state of perplexity, hesitation, doubt, and mental 
difficulty as well as an act of inquiring, hunting, and searching to solve the sophisticated 
issues. 

As far as the components of reflection are concerned, Mezirow (1977) introduced the 
four main constructs of reflective thinking, namely; habitual action, understanding, 
reflection, and critical reflection. Habitual action is defined as "what has been learnt 
before and through frequent use that is performed automatically or with little conscious 
thought. Common examples are using a keyboard or riding a bicycle" (Kember, Leung, 
Jones, & Loke, 2000, p. 383). The second component, i.e., understanding is the 
application of prior knowledge with no thoughtful evaluation. An obvious example is 
‘book reading’ of university students. Commensurate with Bloom’s (1979) taxonomy, 
knowledge, comprehension, application, analysis and synthesis categories would 
generally be positioned in understanding calibration. The third subscale is reflective 
learning which is "the process of internally examining and exploring an issue of 
concern, triggered by an experience, which creates and clarifies meaning in terms of 
self, and which results in a changed conceptual perspective” (Kember, et al., 2000, p. 
384). The last category is critical reflection which involves an awareness of the reasons 
behind our perceptions, emotions, and actions. This entails realizing that our activities 
are regulated by our values and beliefs and requires a critical appraisal of our 
assumptions from conscious and unconscious prior learning and their outcomes. 

REVIEW OF LITERATURE 

Studies on reflective thinking have paid primary attention towards reflective thinking 
among teachers (e.g., Shokouhi, Moghimi, & Hosseinzadeh, 2015). Only recently 
students' reflective thinking found its way to research studies. These studies have been 
mainly concerned with the nexus between student reflective thinking and some other 
variables such as; learning approaches, self-efficacy, and academic performance, student 
self-assessment of reflection and teacher-awarded marks (Lim-Ng, 2009), reasoning 
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ability, intellectual stimulation, and motivation (Sargent, 2015), critical thinking, self¬ 
monitoring, and academic achievement (Ghanizadeh, 2016). 

One of the major snags in studying reflective thinking revolves around its 
conceptualization and assessment. Over the years, researchers have used several 
methods and approaches to measure reflective thinking (Kalk, Luik, Taimalu, & Taht, 
2014). In particular, these methods include: qualitative approach (e.g., Maaranen & 
Krokfors, 2007) which comprise ethnographic field notes and audio taped discussions 
(e.g., Ottesen 2007), interviews (e.g., Krebel, 2005; Alger, 2006), posting comments in 
blogs (e.g., Shoffner 2009), essays (e.g., Maaranen & Krokfors, 2007), and portfolios 
(e.g., Tigelaar, Dolmans, De Grave, Wolfhagen, & Van Der Vleuten, 2006), quantitative 
approach (e.g., Kember, Leung, Jones, and Loke, 2000; Sobral, 2001; ) and mixed- 
method approach (e.g., Killeavy & Moloney 2010) in which different scales built on 
diverse approaches and theories have been applied to examine reflective thinking. 

One of the most widely known scales of reflective thinking was constructed and 
validated by Kember et al. (2000). The scale known as' reflective thinking questionnaire 
(RTQ)' contains four subscales: habitual action, understanding, reflection, and critical 
reflection. Habitual action is defined as “what has been learnt before and through 
frequent use that is performed automatically or with little conscious thought. Common 
examples are using a keyboard or riding a bicycle” (Kember et al. 2000, p. 383). The 
second component, i.e., understanding is the application of prior knowledge with no 
thoughtful evaluation. An obvious example is “book reading” of university students. 
Commensurate with Bloom’s (1979) taxonomy, knowledge, comprehension, application, 
analysis, and synthesis categories would generally be positioned in understanding 
calibration. The third subscale is reflective learning which is “the process of internally 
examining and exploring an issue of concern, triggered by an experience, which creates 
and clarifies meaning in terms of self, and which results in a changed conceptual 
perspective” (Kember et al. 2000, p. 384). The last category is critical reflection which 
involves an awareness of the reasons behind our perceptions, emotions, and actions. 
This entails realizing that our activities are regulated by our values and beliefs and 
requires a critical appraisal of our assumptions from conscious and unconscious prior 
learning and their outcomes. 

Since the introduction of RTQ, various studies employed the scale to explore different 
dimensions of learners' reflective thinking (e.g., Phan, 2006; Ba^ol & Gencel, 2013; 
Ghanizadeh, 2016). Notwithstanding the high reliability and validity of the original scale 
(Kember et al, 2000), in studies carried out in different contexts, it is generally 
recommended that the scale be contextualized and localized in each context to ensure its 
validity. Efforts to substantiate the validity of RTQ in different countries include: Kalk, 
Luik, Taimalu, and Taht, (2014) in Estonia among student teachers; Ba§ol and Gencel 
(2013) in Turkish with science students; Lucas, and Leng Tan, (2006) in England and 
Wales with accounting and business students. 

Despite various studies conducted in relation to the notion of reflective thinking in 
different contexts and among various disciplines, to the best knowledge of the 
researchers, no study has attempted to localize the instrument in an Iranian context by 
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translating the scale to Persian and then validating the instrument. Consequently, the 
present study seeks to validate RTQ among Iranian university students majoring in 
teaching English as a foreign language (TEFL). It then aims at examining the impact of 
each component of reflective thinking on academic achievement. It also explores the 
role of students’ demographic variables (gender and educational level) in reflective 
thinking. 

To attain the goals of present research, the following research questions were posed: 

1) Is the Persian version of RTQ a reliable and valid tool for measuring Iranian students’ 
reflective thinking? 

2) What is the profile of Iranian university students’ reflective thinking? 

3) Is there any relationship between university students’ reflective thinking and their 
academic achievement as measured by their GPA? 

4) Does university students’ reflective thinking differ with their educational level? 

5) Does university students’ reflective thinking differ with their gender? 

METHOD 

Participants 

One hundred ninety six (196) Iranian university students participated in this study (112 
females and 75 males; 9 participants did not specify their gender). Their age varied from 
20 to 32 years old (M = 22.5, SD = 3.06); 15 participants did not specify their age. They 
were BA and MA students (BA= 101, MA= 95) who were studying English Teaching at 
three universities in Mashhad, a city in Northeast of Iran. 

Instrument 

Reflective Thinking Questionnaire (RTQ) 

To assess reflective thinking, the RTQ developed by Kember, Leung, Jones, and Loke 
(2000) was utilized. It includes 16 items measuring four types of reflective thinking 
(habitual action, understanding, reflection, and critical reflection). According to Leung 
and Kember (2003), the reliability estimates range from .58 to .74 for the four subscales 
of the RTQ. The items are answered on a seven-point scale from 1 (“definitely agree”) 
to 7 (“definitely disagree”); for example, “When I am working on some activities, I can 
do them without thinking about what I am doing.” (habitual action), “1 need to 
understand the material taught by the teacher in order to perform practical tasks.” 
(understanding), “I sometimes question the way others do something and try to think of 
a better way.” (reflection), and “As a result of this course 1 have changed my normal 
way of doing things.” (critical reflection). 

Procedure 

The study was conducted in three universities in Mashhad between October and 
December 2014. 215 questionnaires were distributed out of which 196 were returned. 
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The participation in research was completely voluntary. They were also asked to 
indicate their grade point average (GPA) as an indication of academic achievement as 
well as their demographic information on the questionnaires. 

FINDINGS 

The first phase of the present study included a series of different steps to validate the 
Persian version of the reflective thinking scale. Having translated the scales into Persian, 
a group of experts (two psychometricians, and three English educators) evaluated the 
quality of items in terms of clarity and comprehensiveness. Accommodating the experts' 
views resulted in more refined and comprehensible version of the scale. The translated 
version was then back translated to add additional quality check to the initial translated 
version and to verify the accuracy of the translation. The translated questionnaire was 
then administered to the sample of the study. 

To determine the validity of the translated questionnaire in Iranian context, a 
confirmatory factor analysis (CFA) utilizing the LISREL 8.50 statistical package was 
performed. The model consisted of four factors: habitual action, understanding, 
reflection, and critical reflection. Each factor contained four items. A number of fit 
indices were examined to evaluate the model fit: the chi square/c/f ratio which should be 
lower than 2 or 3, the normed fit index (NFI), the good fit index (GFI), and the 
comparative fit index (CFI) with the cut value greater than .90, and the root mean square 
error of approximation (RMSEA) of about .06 or .08 (Schreiber, Amaury, Stage, 
Barlow, & King, 2006). The structural model is presented in Figure 1. As indicated by 
Figure 1, the chi-square/c//ratio (2.66), the RMSEA (.068), GFI (.89), GFI (.90), and 
CFI (.90) all reached the acceptable fit thresholds. 

The indices on the lines indicate the standardized estimates and /-values, respectively. 
The first one is the standardized coefficient (f>) which demonstrates the factor loading of 
each item with respect to the corresponding factor and presents an easily grasped picture 
of effect size. The closer the magnitude to 1.0, the higher the correlation and the greater 
the factor loading of the item is. The magnitude of lower than 0.30 is an indication of 
weak factor loading; in such cases the item must be revised or discarded. The second 
measure is the f-value (t); if f > 2 or t< -2, we call the result statistically significant. As 
the figure demonstrates, all items had accepted factor loadings enjoying f-values higher 
than 2 and f> indices greater than 0.30. 
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Figure 1 

The schematic representation of reflective thinking and its comprising factors 

The convergent validity of the four-factor model was then model computed via 
correlation between factors. Table 1 below represents the results. 


Table 1 

The Correlation Coefficients among Reflective Thinking Components (Habitual action. 
Understanding, Reflection, Critical Reflection) and GPA 



HA 

UND 

REF 

CREF 


1. HA 

1.00 





2. UND 

-.62** 

1.00 




3. REF 

-.57** 

.84** 

1.00 



4. CREF 

-.60** 


70** 

1.00 



**Correlation is significant at the level of 0.05 


As the Table indicates, the model with the best fit demonstrated inter-correlation 
between the scales or latent factors with REF and UND having the highest correlation 
0-.84, /;<().05) and HA having negative associations with other components. This is in 
accordance with the validity indices of the original scale as reported by Kember et al 
(2000). As contended by Kember et al (2000), this finding is predicted conceptually 
given that those involved in critical refection are also likely to have reflected upon their 
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practice. Students who engage in either form of reflection may also have a tendency to 
study for understanding, particularly in more theoretical parts of a course, which have 
less obvious relationships to practice. The negative correlation between critical 
reflection and habitual action may be explained in the light of the conceptualization of 
habitual action which has a more mechanical and perfunctory nature. The other three 
components, nevertheless, require conscious attention, evaluation, and deep 
comprehension. 

The reliability of the questionnaire estimated via Cronbach's alpha was found to be .81. 
The reliability of each subscale was as follows: habitual action (.78), understanding 
(.84), reflection (.80), and critical reflection (.74). Overall, it can be concluded that the 
Persian version of reflective thinking questionnaire had acceptable reliability and 
validity indices. 

Table 2 presents descriptive statistics of EFL learners' reflective thinking comprising 
four components. As the Table shows, among the comprising factors of reflective 
thinking, understanding (M= 13.95, 577=3.47) has the highest mean followed by 
reflection (A/=13.30, 577=3.26). Habitual action (M=10.17, 577=2.64) receives the 
lowest mean score. 

Table 2 


Descriptive Statistics of the Comprising Factors of Reflective Thinking 



Min 

Max 

Mean 

SD 

Habitual Action 

5.00 

16.00 

10.17 

2.64 

Understanding 

5.00 

20.00 

13.95 

3.47 

Reflection 

6.00 

20.00 

13.30 

3.26 

Critical Reflection 

5.00 

20.00 

12.55 

2.79 

Valid N (listwise) 

196 





To see whether these observed differences among the four components of reflective 
thinking are statistically significant, a one-way ANOVA was applied to the data. The test 
also serves as the discriminative evidence of the scale. 

Table 3 


The Results of One-Way ANOVA for Determining Differences among the Components 
of Reflective Thinking _ 



Sum of Squares 

df Mean Square 

F Six- 

Between Groups 

1275.54 

3 425.18 

45.29 .000 

Within Groups 

5820.44 

620 9.38 


Total 

7095.98 

623 



As Table 2 indicates, there are significant differences among the four subscales of 
reflective thinking (F= 45.291, /;<().05). 


The ANOVA analysis revealed that among the four components of reflective thinking, 
there is a difference somewhere among the means, but the precise location of differences 
is not clear. To locate the exact place of differences, a post-hoc comparison of the 
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means was run for the five dimensions. In so doing, a Scheffe’s test was utilized. Table 
4 displays the results of Scheffe’s test. 


Table 4 

The Scheffe’s Test for Determining the Location of Difference across the Four 
Reflective Thinking _ 


(I) 

VAR00002 

(J) 

VAR00002 

Mean 

Difference (I- 

J) 

Std. 

Error 

Sig. 

95% Confidence Interval 
Lower Upper 

Bound Bound 


UND 

-3.78* 

.34 

.00 

-4.75 

-2.80 

HA 

REF 

-3.12* 

.34 

.00 

-4.10 

-2.15 


CREF 

-2.37* 

.34 

.00 

-3.35 

-1.40 


HA 

3.78* 

.34 

.00 

2.80 

4.75 

UND 

REF 

.65 

.34 

.31 

-.31 

1.62 


CREF 

1.40* 

.34 

.00 

.43 

2.37 


HA 

3.12* 

.34 

.00 

2.15 

4.10 

REF 

UND 

-.65 

.34 

.31 

-1.62 

.318 


CREF 

.75 

.34 

.19 

-.22 

1.72 


HA 

2.37’ 

.34 

.00 

1.40 

3.35 

CREF 

UND 

-1.40* 

.34 

.00 

-2.37 

-.43 


REF 

-.750 

.346 

.198 

-1.72 

.22 


*. The mean difference is significant at the 0.05 level. 


The results of the post hoc Scheffe’s test revealed that, at the level of 0.05 there was a 
significant difference between HA, UND, REF, and CREF. The mean scores of UND is 
significantly different from those of HA and CREF but not from that of REF. The mean 
scores of REF is significantly different from that of HA but not from mean scores of 
UND and CREF. The mean scores of CREF is significantly different from HA and UND 
but not from that of REF. 

To examine the relationship between reflective thinking and academic achievement 
(GPA), a Pearson product-moment correlation was run. Descriptive statistics of students' 
GPA are as follows: minimum= 13.50, maximum= 18.25, mean= 16.34, and SD= 1.20. 
The correlation coefficients among EFL learners' reflective thinking and academic 
achievement (GPA) are presented in Table 5. As it can be seen, the highest correlation is 
observed between UND and GPA (r = 0.566, p < 0.05). The second higher correlation 
was found between REF and GPA (r = 0.477, p < 0.05), followed by CREF and GPA (r 
= 0.477, p < 0.05). It was also found that there is a negative significant correlation 
between HA and GPA (r = - 0.327, p < 0.05). 

Table 5 


The Correlation Coefficients between Reflective Thinking (Habitual action. 
Understanding, Reflection, Critical Reflection) and GPA 



HA 

UND 

REF 

CREF 

GPA 

_ 32 ** 

.56** 

47 ** 

44 ** 


* Correlation is significant at the level of 0.05 
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To delve more into EFL learners' reflective thinking, the association of each thinking 
style with learners' demographic variables such as, gender and educational level was 
estimated. 

The following Table shows the descriptive statistics of thinking styles across two 
educational levels: 1) BA and 2) MA. 


Table 6 

Descriptive Statistics of Reflective Thinking across BA and MA University Students 



Level 

N 

Mean 

Std. Deviation 

Std. Error Mean 

ri a 

1.00 

101 

11.59 

2.44 

.28 

ri A 

2.00 

95 

8.98 

2.19 

.23 

T TXTn 

1.00 

101 

11.09 

2.51 

.29 

U1NU 

2.00 

95 

16.34 

2.09 

.22 


1.00 

101 

10.61 

2.20 

.26 

ivcr 

2.00 

95 

15.54 

2.11 

.22 

cppp 

1.00 

101 

10.64 

2.23 

.26 

i^ivtLr 

2.00 

95 

14.14 

2.14 

.23 


As the Table indicates, BA students obtained higher mean scores in HA but lower mean 
scores in the other three thinking styles in comparison with their MA counterparts. To 
see if these observed differences are significant statistically, a one-way between-groups 
multivariate analysis of variance (MANOVA) was run to examine the differences in 
reflective thinking in relation to the educational level. Four dependent variables were 
generated: habitual action, understanding, reflection, and critical reflection. The 
independent variable was educational level. Preliminary assumption testing was 
conducted to check for normality, linearity, univariate and multivariate outliers, 
homogeneity of variance covariance matrices, and multicollinearity, with no serious 
violations noted. The results of MANOVA presented in Table 7 revealed that was a 
statistically significant difference between BA and MA students on the combined 
dependent variables (reflective thinking): (/• =52.80, 473, p= .000, Wilks' 

Lambda=1.39). The effect size computed via partial eta squared was found to be .58 
which is a quite high magnitude according to Cohen's F. This implies that about 58 
percent of variance in reflective thinking can be accounted by educational level. 

Table 7 

MANOVA Table Displaying the Results of Level Differences in Reflective Thinking 


Effect 


Value 

F Hypothesis 
df 

Error 

df 

Sig. 

Partial Eta 
Squared 

Level 

Wilks' Lambda 

1.39 

52.8 4.00 

151.00 

.00 

.58 


The follow-up analysis represented in Table 8 demonstrated that this difference holds 
true across all four components of reflective thinking: HA (,F=49.23, p= .000, partial eta 
squared =.24), UND (T=201.80, p= .000, partial eta squared =.56), CREF (F=201.01, 
p= .000, partial eta squared =.56), CREF (/• =98.71, p= .000, partial eta squared =.39). 
As it can be seen, the highest difference in observed in UND followed by REF in favor 
of MA students. The lowest difference is obtained in HA in favor of BA students as the 
inspection of mean scores indicated. 
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Table 8 

MANOVA Table Displaying the Results of Level Differences in the Components of 
Reflective Thinking _ 


Source 

Dependent 

Variable 

Type III 
Sum of 
Squares 

df 

Mean 

Square 

F 

Sig. 

Partial Eta 
Squared 


HA 

262.18 

1 

262.18 

49.23 

.00 

.24 

Level 

UND 

1063.27 

1 

1063.27 

201.80 

.00 

.56 

REF 

937.00 

1 

937.00 

201.01 

.00 

.56 


CREF 

472.08 

1 

472.08 

98.71 

.00 

.39 


Identical analysis was conducted for the role of gender in each thinking style. Table 9 
presents the descriptive statistics of thinking styles across genders: 1) female and 2) 
male. 

Table 9 


Descriptive Statistics of Reflective Thinking across Male and Female University 
Students 



Gender 

N 

Mean 

Std. Deviation 

Std. Error Mean 

HA 

1.00 

112 

10.19 

2.41 

.23 

2.00 

75 

10.12 

3.04 

.41 

UND 

1.00 

112 

13.94 

3.48 

.34 

2.00 

75 

13.98 

3.50 

.47 

REF 

1.00 

112 

13.21 

3.26 

.32 

2.00 

75 

13.46 

3.29 

.44 

CREF 

1.00 

112 

12.48 

2.74 

.27 

2.00 

75 

12.68 

2.89 

.39 


T As the Table indicates, male and female students' scores on reflective thinking are 
quite close to each other. A MANOVA was performed to see if these slight differences 
are statistically different. Four dependent variables were generated: habitual action, 
understanding, reflection, and critical reflection. The independent variable was gender. 
Preliminary assumption testing was conducted to check for normality, linearity, 
univariate and multivariate outliers, homogeneity of variance covariance matrices, and 
multicollinearity, with no serious violations noted. The results of MANOVA presented 
in Table 10 revealed that was not a statistically significant difference between males and 
females on the combined dependent variables (reflective thinking): (F= 0. 47, p= .75, 
Wilks'Lambda= .98). 

Table 10 

MANOVA Table Displaying the Results of Gender Differences in Reflective Thinking 


Effect 

Value 

F Hypothesis 

df 

Error 

Df 

Sig. 

Partied Eta 
Squared 

Gender Wilks' Lambda 

.98 

.47 4.00 

151.0 

.75 

.01 
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DISCUSSION 

The present study aimed at exploring the effects of four components of reflective 
thinking namely; understanding, reflection, critical reflection, and habitual action on 
university students' academic achievement. It also delved into the role of student 
demographic variables (educational level and gender) in student reflective thinking. To 
attain the goals of present research, the Persian version of reflective thinking 
questionnaire was administered to a sample of Iranian university students. The results of 
CFA and reliability estimates substantiated the validity and reliability of the scale. 

As the results demonstrated, understanding received the highest mean followed by 
reflection and critical reflection. Habitual action, on the other hand, had the lowest mean 
score. In other words, the ability to analyze and critique information at a high-order 
level, i.e., understanding, reflection, and critical reflection, is demonstrated among 
higher education students more frequently than abilities associated with lower-order 
thinking such as memorization and rote-learning, i.e., habitual action. In effect, reflection 
and critical reflection components constitute deep learning approaches by which higher 
education learners can overcome uncertainties and fears to have a critical evaluation of 
their practices and make meaningful changes. Such differences are due to the particular 
characteristics of higher education students. In particular, university students are 
expected to build a deep understanding of the core concepts of course materials, prevent 
mechanical and habitual learning, try to be intrinsically motivated, autonomous, be 
responsible for their own learning and progress to enhance problem solving strategies, 
reflect on their accomplishments, and evaluate or self-monitor their work (Boyd & 
Fales, 1983; Mezirow, 1997; Monshi Tousi & Ghanizadeh, 2012). Consequently, higher 
education students should gain profound insights which cannot be manifested in habitual 
actions. 

The above finding corroborates the contention that development through enhanced 
reflective thinking occurs most frequently during higher education (Kitchener & King, 
1981, as cited in Sargent, 2015). It is also in concert with Sargent's (2015) study among 
college students. It was revealed that habitual thinking had lowest score whereas 
understanding score was the highest. Also, it was reported that nearly all students 
believed that college required them to understand and reflect. The findings of the current 
research also demonstrated the highest correlations between understanding and academic 
achievement followed by reflection and critical reflection, respectively. Habitual action, 
on the other hand, was found to have a negative relationship with student academic 
achievement. There is a general consensus among educationalists that developing higher- 
order thinking skills of university students must constitute an indispensable part of the 
agenda of higher education. Scholars in the field of higher education contended that 
reflective thinking is a standard of intellectual excellence required for full and 
constructive participation in academic, individual, and social lives of students (Scriven 
& Paul, 2004). 

This finding corroborates previous studies in which the use of higher-order learning 
strategies often leads to improvements in student proficiency and achievement (Watkins, 
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Regmi, & Astilla, 1991; Thompson & Rubin, 1993; Drew & Watkins, 1998; Eklund- 
Myrskog & Wenestam, 1999; Watkins, 2001; Lucas, 2012). Moreover, strategic learners 
adapt metacognitive knowledge for their learning approaches and a comprehensive 
understanding of what a task entails (Chamot, 2004). Key to this discussion, educational 
scholars considered reflection a form of freedom from routine behavior which 
emancipates us from merely impulsive and routine activity; it enables people to direct 
their activities with foresight and to plan according to ends-in-view or purposes of which 
they are aware, to act in deliberate and intentional fashion, to know what they are about 
when they act (Farrell, 2014). 

The next finding of the present study revealed that graduate higher education students 
(students studying in MA or having a MA degree in this study) employed deep thinking 
styles, i.e., understanding, reflection, and critical reflective thinking more frequently 
than their BA counterparts. The fluctuations regarding the use of reflective thinking 
strategies can be justified by the variation of learners’ attitudes of academic achievement 
as their transition from BA to MA level. Such an alternation can be followed by changes 
in students’ efficacy beliefs, motivation levels, and goal settings (Phan, 2009). Since 
higher education learners at MA levels are empowered by social and environmental 
factors and are expected to write a thesis before graduating from the program, they 
experience more challenges than BA counterparts. Consequently, they are expected to 
be involved in reasoning, hypothesizing, problem solving, and assessing, all of which 
are manifestation of reflective thinking. Overall, this attested to Fischer and Pruyne's 
(2003) belief that student variables regulate the direction and area in which thinking 
develops (as cited in Sargent, 2015). 

The last finding of this research concerned gender differences in reflective thinking. No 
differences were observed across the four comprising factors of reflective thinking. That 
is, both male and female university students are virtually involved in learning strategies 
and higher order thinking skills to facilitate the learning process. The finding is in line 
with previous studies finding no statistical difference between males and females 
regarding their use of reflective thinking strategies (King & Kitchener, 1994; Phan, 
2009). It, nevertheless, contradicts a recent study by Sargent (2015) who detected 
gender differences in undergraduates' reflective thinking across three disciplines. In 
particular, it was reported that males reported more reflection in business courses than 
the humanities or science courses, while females displayed more reflection in humanities 
and science courses and less in business courses. 

CONCLUSION AND IMPLICATION 

Taken together, the findings of the present study shed light on the crucial role of 
reflective thinking components in students’ academic achievement. It also put forward 
important implications for both higher education instructors and students. Higher 
education instructors should underscore the belief that teaching for thinking skills is an 
important goal of modern education, given that it provides students with the abilities 
necessary to reason about social affairs in a rapidly changing world (Ku, 2009). Hence, 
reflective practice on the part of the teachers enables them to act in a critical manner, 
stimulate deep understanding, trigger positive change, and raise their awareness 
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regarding the act of teaching (Farrell, 2014). Second, instructors' involvement in 
reflective teaching improves students’ ability to investigate reflective thinking strategies 
(Yost, Sentner, & Frolenza-Baily, 2000). 
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Turkish Abstract 

Yansitici Dii§unme Anketinin Fars^a Versiyonunun Dogrulanmasi ve iran Universite 
Ogrencilerinin Yansitici Dii§iince ve Akademik Basarilarinin incelenmesi 

Yiiksekogretimdeki ara§tirmacilar, mesleki disiplin uygulamalanmn geli§tirilmesinde yansitici 
du§unmenin ayrilmaz bir par?a olduguna inanmaktadirlar. Yansitici du§unmenin 
ara§tirilmasindaki en onemli konulardan biri yansitici du§unmenin kavramsalla§tirilmasi ve 
degerlendirilmesi etrafinda §ekillenmektedir. Yillar boyunca ara§tirmacilar, yansitici du§unmeyi 
61?mek i 9 in 9 e§itli yontemler ve ol 9 ekler kullanmi§lardir. En yaygin olarak bilinen dii§unsel 
ol 9 eklerden biri Kember ve digerleri tarafmdan geli§tirilmi§ ve onaylanmi$tir. (2000). B ok^ek 
"Rcflektif Du^iinme Anketi (RTQ)" ba§likli ve dort tiir yansitici du§iinceyi ol 9 en 16 madde 
i 9 ermektedir: Anlama (UND); Yansitma (REF); Ele§tirel yansnna (CREF); Ali^ilmi? eylem (E1A). 
Bu 9 ali 5 ma, yuz doksan alti Ingilizce yabanci dil (EFL) universite ogrencisi arasinda RTQ'nun 
Fars 9 a versiyonunun ge 9 erliligini saglamayi ama 9 lamaktadir. 

Anahtar Kelimeler: EFL ogrencileri, yansitici du§unme, dil ogrenme ba^arisi (GPA), anlama 
(UND), yansitma (REF), ele§tirel yansitma (CREF), ali§ilmi!j eylem (FTA) 


French Abstract 

Yalider la Version persane de Questionnaire Pensant Reflechissant et des Investigations de 
la Pensee Reflechissante des Etudiants Universitaires iraniens et l'Accomplissement 
Universitaire 

Les erudits dans l'enseignement superieur considerent la pensee reflechissante comme integral au 
developpement de pratiques disciplinaires professionnelles. Un des problemes majeurs dans etude 
de pivots pensants reflechissants autour de sa conceptualisation et evaluation. Au fil des ans, les 
chercheurs ont utilise plusieurs methodes et echelles pour mesurer la pensee reflechissante. Une 
de des echelles le plus largement connue de pensee reflechissante a ete construite et validee par 
Kember et d'autres. (2000). II a droit' le Questionnaire Pensant Reflechissant(Reflechi) (RTQ)' et 
inclut 16 articles mesurant quatre types de pensee reflechissante: comprehension (UND); 
reflexion(reflet) (REF); reflexion(reflet) critique (CREF); action habituelle (HA). L'etude 
presente a vise a valider la version persane de RTQ parmi cent quatre-vingt-seize anglais langue 
etrangere (EFL) des etudiants universitaires. 

Mots Cles: EFL apprenants, pensee reflechissante, accomplissement de langue (GPA) 
comprehension (UND), reflexion(reflet) (REF), reflexion(reflet) critique (CREF), action 
habituelle (HA) 
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Arabic Abstract 

4* a\ V;1 t_ibUa jjSjMI jaljWilj 4 ■ .<11 ’' jjSiMI jUi-' 4-iojjLaJ! 4 4 , jbV'’' 

yAjjliVI 

4. u^II U i '--.all /jm SAaIj .4j~', 4_ujjbll CIjUjLaaII 1 j V; V b Jja. ^IaII sjIajII ;U:C j ,: -j 

^>Aja] ^jujILoj *4c. ^jjjCkbll - 4'i L ,l . /jj'.. M ^ lA jj*sZs 4jj_jaa ^Labll 4*djA 

j;'..' : A ..-a ^jiV'.Vl j lAjlij ^bi j^Ljlbll j ;4^'-'I Jjliaj .^^Ic 43j_)*-ail jjjiuliaJI Jj£l b4° 4 -AaIj .^^Laljil 

^i]| ;^LaUil j.jbbVl ^ £-l^ji 4 ajj 1 Ibb 16 J-abbj (RTQ) "(_>“£Ia]I ^jbmjjjl 11 4bl^jcj .(2000) .(jj-AD 
4 S.--’:" 4 ^£aj]I obA ." '4 '>■ .(HA) bljA-all JaaII (GREF) ^jl^AjI t(REF) ^l^Ail .(UND) 

..’ '.' r ,.' ~-. '. I i_jbLla (EFF) 4 i 4 aK 4 ■ j jla. '.VI jjiAibij 4jbi b)4J ._>* RTQ b>* 4_i**ijUll 
^AliAll j <(GPA) jIacVI j i<uSU 1I jj£biil t FFF4 ^ i 4 aK 4 ■ jjla.j v jl 4 aI]I ^iaIaHaII ;4;.: ^I'l CbLaKlI 

(HA) aUaaII JaJIj ^jS) cfiill ^(SajI <(REF) ui£«jl j <(UND) 


German Abstract 

Validierung der persischen Version des reflektierenden Denken Fragebogens und Probing 
Reflective Thinking und akademische Leistung der iranischen Universitatsstudenten 

Gelehrte in der Hochschulbildung sehen das reflektierende Denken als integraler Bestandteil der 
Entwicklung von professionellen Disziplinarpraktiken an. Eines der Hauptprobleme beim 
Studium des reflektierenden Denkens ist die Konzeption und Bewertung. Im Laufe der Jahre 
haben die Forscher mehrere Methoden und Skalen verwendet, um das reflektierende Denken zu 
messen. Eine der bekanntesten Skalen des reflektierenden Denkens wurde von Kember et al. 
Konstruiert und validiert. (2000). Es handelt sich um einen "Reflektierenden Denken Fragebogen 
(RDF)" und umfasst 16 Punkte, die vier Arten von reflektierendem Denken messen: Verstandnis 
(UND); Reflexion (REF); Kritische Reflexion (KREF); Gewohnheitsaktion (GA). Die 
vorliegende Studie zielte darauf ab, die persische Version von RDF unter 
einhundertsechsundneunzig Englisch als Fremdsprache (EAZ) Universitatsstudenten zu 
validieren. 

Schliisselworter: EAZ-Lemende, reflektierendes Denken, Spracherfolg (SE), Verstandnis (UND), 
Reflexion (REF), kritische Reflexion (KREF). Gewohnheitsaktion (GA) 
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Malaysian Abstract 

Mengesahkan Versi Parsi Pemikiran Mencerminkan Refleksi dan Pengajaran Pemikiran 
Reflektif dan Pencapaian Akademik Pelajar Universiti Iran 

Ulama dalam pendidikan tinggi menyatakan pemikiran reflektif sebagai penting kepada 
pembangunan amalan disiplin profesional. Salah satu isu utama dalam mengkaji pivots pemikiran 
reflektif di sekitar konsep dan penilaiannya. Selama bertahun-tahun, penyelidik telah 
menggunakan beberapa kaedah dan skala untuk mengukur pemikiran reflektif. Salah satu 
daripada skala paling terkenal pemikiran reflektif telah dibina dan disahkan oleh Kember et al. 
(2000). Ia bertajuk 'Soal Selidik Pemikiran Reflektif (RTQ) dan termasuk 16 barangan berukuran 
empat jenis pemikiran reflektif: persefahaman (UND); pantulan (REF); refleksi (CREF); tindakan 
yang lazim (HA). Kajian ini bertujuan untuk mengesahkan versi Parsi RTQ antara 196 Bahasa 
Inggeris sebagai bahasa asing (EFL) pelajar universiti. 

Kata Kunci: pelajar EFL, pemikiran reflektif pencapaian bahasa (GPA), pemahaman (UND), 
refleksi (REF), refleksi kritikal (CREF), tindakan yang lazim (HA) 


Russian Abstract 

Ba.iu iauuu nepcii.tCKOM Bepcnn PetjuieKCH biioio MbiuuieHHH AHKeTa n Pacc.ietOBamie 
PetJtJieKCHBHOro IVlbiiii.ieHiin n Aka.ieMimeckiix Hnciuvueimii ynaiunxcn IIpaHCKOro 
ymiBepcHTCTa 

yueHbie c BbicmtiM o6pa30BaeneM cuaTatoT petjraeKCBBBoe Mbimjieqae neo6xoqaMbiM qna 
pa3BHTra qpotjteccaoqajibBbix qacqaqjiBBapBbix npaKTHK. Oqna B3 ochobhwx npo6jieM b 
H3yueHHH peijraeKTHBHoro Mbiinjieqna CBoqaTca k ee KOHqeriTyann3aqnn q oqeqice. Ha 
qpoTaaceqqq MBornx aeT accJieqoBaTejia qcqoJib30Bajin necKOJibKO MeToqoB n mKaji qua 
M3Mepeqqfl peijraeKciiBBoro Mbiinjieqaa. Oqaq M3 qan6oJiee rnapoKO M3BecTBbix MacmTa6oB 
petjmeKCHBBoro Mbiinjieqaa 6biJi qocTpoen h aoqTBepayteq KeM6epoM q qp. (2000). Ob 
03arjiaBJieq icaic ‘Boapocnaic PetjraeiccnBBoro Mbiqqieqaa (RTQ)’ a BKJirouaeT b ce6a apeqMeTbi 
ueTbipex tbbob peijuieKCUBBoro Mbiqqieqaa: noiiHMaiiue (UND); OTpaacenae (REF); 
KpiiTiiuecicaa petjraeiccna (CREF); npiiBbiqqoe qeacTBae (HA). HacToaiqee accqeqoBaqae 6biJio 
qaqpaBJieqo na yTBepxcqeqae aepcaqcKoa Bepcan RTQ cpeqa CTa qeBanocTa mecTa uenoBeK, 
a3yuaioiqax aarjiaacKaa icaic aaocTpaqabia a3MK. 

KjiKtueBbie CaoBa: yuaiqaeca EFL, petjraeKCBBnoe Mbimaeqae, a 3 WKOBbie qocTaxceqaa (GPA), 
qoBBMaaac (UND), pecjmeKcaa (REF), KpiiTiiuecKoe OTpaacenae (CREF), qpiiBbiHBoe qeacTBae 
(HA) 
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